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Abstract — 

Empirical Mode Decomposition(EMD) is an 
adaptive data analysis technique for analyzing 
nonlinear and non stationary datafl]. EMD 
decomposes the original data into a number of 
Intrinsic Mode Functions(IMFs) [l] for giving 
better physical insight of the data. Permuta¬ 
tion Entropy (PE) is a complexity measure [3] 
function which is widely used in the field of 
complexity theory for analyzing the local com¬ 
plexity of time series. In this paper we are 
combining the concepts of PE and EMD to 
resolve the mode mixing problem observed in 
determination of IMFs. 

Introduction 

Empirical Mode Decomposition proposed by Huang Et 
al.[T] serves as a widely used and effective method for 
analyzing nonlinear and non stationary data [5]. It de¬ 
composes the original data into a finite and often small 
number of well behaved Hilbert transformable [8] intrinsic 
mode functions(IMEs). Due to its adaptive nature and 
instantaneous frequency [8] determinable IMEs it gives a 
sharp identification of the embedded structure and hence 
is highly efficient in terms of analyzing physical reality [S] 
of the data. 

’’Mode mixing” is defined as any IME consisting of oscil¬ 
lations of dramatically disparate scales [2], mostly caused 
by intermittency of the driving mechanics. Mode mixing 
leads to deceptive physical meaning of the mixed mode 
IMEs [5]. Hence mode mixing problem is the major draw¬ 
back of the EMD and was first illustrated by Huang et 
al.[5] 

Permutation entropy proposed by Bandt et alia is an 
effective way of measuring the complexity of the time 
series by comparing the neighboring values around each 
point. Eurther Cao et al.[6] showed that it is an efficient 
way for Detecting dynamical changes in time series. This 
shows the adaptive nature [3] of the technique. Hence it 
can be concluded that the combination of EMD and PE 
will maintain its adaptivity and can be used for adaptive 
data analysis. 

Empirical Mode Decomposition 

Empirical Mode Decomposition proposed by Huang et 
al. (1998) [1] is an effective algorithm to decompose time 
series into the so-called Intrinsic Mode Eunctions. These 


modes form a (quasi-)orthogonal set of basis functions 
that is derived directly from the original data without a 
priory assumptions [T] about their nature. In addition to 
orthogonality of the total set of basis functions, each IME 
should have the following property 

• Number of extreme values and zero crossings differ at 
most by one. 

• The ’’local mean” value of the mode is zero . 

In order to get the IMEs from the original data set we 
can follow the following algorithm 

1) Start with a discrete time series x(t) with sampling 
period Ts. 

2) Compute all maximum (minimum) values of x(t), 
perform cubic spline interpolation, Smax{smin)^ for 
these values. 

3) Estimate the local mean of the time series as 


4) Subtract m(t) from x(t) and repeat step — 1^ 2, 3 with 
the resulting time series, until a stopping criterion is 
reached. 

5) Once the stopping criterion is reached name the 
function as first IME (ci). Subtract this IME from 
the original signal and repeat the steps — 1,2, 3,4 
until getting the residue. 

6) Residue is characterized as the mode function which 
does not have enough extremas for interpolation. 
This residual can be regarded as the global trend, 
r(t), of the time series 

Hence with the EMD algorithm we can decompose any 
time series into its IMEs(ci) and residue(r(t)) as 

n 

x{t) = Y2ci{t) + r{t) 

where n is the total number of IMEs obtained from the 
original time series. 

Permutation Entropy 

The quantification of complexity of a time series plays 
a crucial role in biomedical analysis [7] as well as in 
other branches of nonlinear sciences. Various complexity 
measures have been proposed and is used to study the 
complexity of time series data to get the useful infor¬ 
mation about the temporal dynamical changes in time 
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series. Some of the widely used complexity measure are 
correlation dimension and the Kolmogorov-Sinai entropy 
and Permutation entropy (PE). Permutation Entropy is 
a conceptually simple method that allows the analysis 
and representation of a time series through a symbolic 
sequence. The advantages of the PE method reside in 
its simplicity, its robustness [3]. In addition, this method 
provides an extremely fast computational algorithm and 
it can be applied to any type of time series. 

Eor calculating the PE of a given time series we can 
proceed with the following procedure. 

Consider the measured scalar time series data x(t^), for 
n = 1, 2 ,..., where i denotes the i-th variable of the system. 
Eirstly, we divide the long time series into segments with 
fixed finite length r(for convenience we have chosen the 
length r to be 120 here) which can be denoted as Tj (j 
= 1, 2,....). These TjS are obtained by applying running 
windows over our original time series. In our case we 
have chosen the step size 1 to have a better information 
about the complexity variation over time. Eurther we use 
another sliding-window analysis to partition each Tj into 
short sequences of given length m. Eor convenience we have 
taken the value of m to be 3 here. Eig. 1 describes the 
complete procedure of sliding windows graphically. In this 
we for a segment of time series with length , the total 
number of short sequences will be — m + 1. Inside a short 
sequence, we distinguish it as a pattern by the natural 
position order. It can be easyly observed that for our case 
m = 3, we can have six different possibilities such as 

• x{ti) < x{tij^i) 

• x{ti) < x(ti+2), 

• X(ti+i) < X{ti) 

• X(ti+i) < x(ti+2), 

• X{tij^2) < X{ti) 

• X{tij^2) < 

Using Pi (i = 1,...,6) to denote the probability that one 
of the patterns appears in the time series of a segment, we 
can define the permutation entropy H{rj) as 

3! 

= - 'Y^Pdn{pi) 
i=l 

Eor making pi roughly reflect the local structure of time 
series, the number of short sequences in r should not be 
too small, i.e.^Ni — m + 1 > loog. 

Because the time series is always changing with time, 
H{Tj) changes with time period interval Tj and will be 
determined by the local topological structure of the time 
series [3]. Eor determining the complexity measure in terms 
of permutation entropy [3] around each point of our time 
series we are calculating the permutation entropy by tak¬ 
ing the running windows of along the whole time series 
data. 

Eor solving the mode mixing problem observed in the 
calculation of empirical mode functions(IME) using Em¬ 
pirical Mode Decomposition we can follow the following 
algorithm. 


Running 
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Eig. 1: Showing the sliding windows m and Ti in Ti and 
time series respectively 


1) Calculate the Permutation Entropy of the time se¬ 
ries for a particular length(r) with short sequence 
length(m) around each point. 

2) Extract the high entropic portions from the time 
series and run EMD in each portion. 

3) Calculate the PE values for each IMEs. 

4) Compare the PE values of IMEs and the original time 
series and replace the high entropic portions with 
appropriate IMEs. 

5) Now run EMD in both time series i.e, the repaired 
original data and the intermittent extracted compo¬ 
nent to get the desired result. 

Detailed Methodology 

As shown in the Eig.2 the intermittent portion of our 
signal can be easily detected with the help of Permutation 
Entropy Algorithm. The increase in complexity of the 
signal in the intermittent part can be easily observed by 
the higher entropic value of the region. Eor detecting the 
onset and offset of the noise in our original signal the 
following algorithm is applied 

• Calculation of permutation entropy around each point 
of our time series. 

• Eor detecting the region of increased permutation 
entropy 

— Taking the maxima envelop of Permutation En¬ 
tropy. 

— Calculating the statistical mode of the maxima 
envelop of the permutation entropy. 

— Considering the portions of the Entropy curve 
above the mode level and extracting the data 
from the original time series at that particular 
portion. 

This algorithm seems very specific for our problem but 
subsequently we will have to come up with a more general 
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algorithm to extract the noisy part (high frequency part) 
from the time series. 

Fig.2,3,4,5 represents the entire methodology for ex¬ 
tracting the intermittent part from the original signal. 

Detecting the frequency variation 

For our purpose we are particularly interested in detect¬ 
ing variation in frequency and want to avoid the detection 
of any amplitude change in our time series. But the above 
technique becomes problematic in certain cases where both 
amplitude as well as frequency changes are detected by the 
permutation entropy filter. So instead of running the PE 
directly on the time series it is better to run it on the 
gradient of the time series. According to the definition of 
gradient : 

dy 

gradiy) = 

I dt I 

Where y and t are the data points and the time points 
in the time series. In this way every sequence of the 
time series gets a value of +1 and —1 for increasing and 
decreasing portions respectively. Afterwards applying PE 
algorithm on the gradient set gives a better result than 
the previous one. 



Eig. 2: Permutation Entropy for time series 


Eig. 3: Extracted time series based on high PE value 





Conclusion 

Even though various modification to EMD has been pro¬ 
posed like EEMD[2] to resolve the mode mixing problem 
observed in IME determination. But most of them seem 
computationally expensive and inappropriate for applica¬ 
tion in real time data analysis. Proposed algorithm de¬ 
scribes the selective implementation of EMD/HHT which 
can adaptively determine the desired portions with the 
help of local entropic value and extract useful information. 
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Eig. 4: Empirical Mode Decomposition for the selected 
time series portions 



Eig. 5: Extracted Intermittent component and low fre¬ 
quency components 









































































